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IIXLAGE PROCESSING APPARATUS, 
DATA PROCESSING METHOD, AND STORAGE MEDIUM 

BACKGROUND OF THE INVENTION 
5 Field of tlie Invention 

The present; invenr.ion relates to an image 
processing apparatus, a data processing method, and a 
storage medium. 
Related Background Art 

10 There has been no conventional means to prevent 

production given in digital information from being 
copied illegally or no means established to essentially 
protect production, (^^^ example, a conventional intage 
processing system which comprises a print controller 

15 which receives image data coded in a page-description 
language from a host computer and converts the data 
into raster image data and then sends it to an image 
forming device and the image forming device which forms5 
images based on the image data thus sent, from the print 

20 controller has no means to recognize image data sent 
from the print controller even if it is production, 
thus being unable to prevent such production from being 
copied illegally. ^ 

In the recent background that has strengthened 

25 legal protection of production given in digital 

information^ a technological method is required to 
legally prevent illegal copying of production by use of 



I 



a copying machine^ printer, etc 

On tl^e other hand, however^ the copyxighi of some 
production can be bought from the author to output, it 
with permission from him. 

Such production needs to be released from its 
prohibition state of the image data protected (i,e,, 
copy-protected) based on production inf orma l:ion, which 
has not been taken into account. Therefore, there have 
been such cases that even with permission obtained from 
the author, his production Ccjnnot be output. 

Also, there has not been discussed fully about 
technologies to provide other pieces of production 
relating to one production based on its information 
obtained- 

SUMMARY OF THE INVENTION 

In view of the above, it is an object of the 
present invention to provide an image processing 
device, a data processing method, and a storage mediui" 
that have solved the above-mentioned problems . 

Another object of the present invention is to 
provide such an image processing device that can 
appropriately process production and a method fox- 
processing data as well as a storage medium for this 
purpose _ 

An appropriate e:>cample of the present invention is 
written in a claim 1. 



St:±ll anot:her objec-t of the present; inveii-tion it-; 
■to provide such an image processing apparatus that: has 
a novel function and a data processing method a?; well 
as a storage medium tor this purpose . 

The other objects and features of the present 
invention will be apparent from the following 
description on the embodiment with reference to Lhe 
appended drawings - 

BRIEF pESCIPTION OF THE DRAWINGS 

Fig. 1 shows outer appearances of a configuration 
of an image processing system according to one 
embodiment of the present invention; 

Fig. 2 is a cross-sectional view o£ a 
configuration of an image processing device shown in 
Fig. 1; 

Fig. 3 is a block diagram of a configuration of an 
image processing unit shown in Fig* 2; 

Fig. 4 is a property graph of one example of a 
gradation correction property of an input/output signal 
at a reader gradation correcting circuit shown in Fig, 
3; 

Fig. 5 is a property graph of one example of an 
input/output signal at an engine gradation correcting 
circuit; 

Fig, 6 is a flowchart illustrating one example of 
a first image data procef^ying procedure; 



Figs. 7A, 7B, 7C, 7D and 7F: sl-iow examples of a 
mark and a charac-ter st.ring which indiCBt;e being 
pr*oduct:ion; 

Figs. 8A and 8B show examples of a warning screen 
5 displayed at. a display portion of an opera Ling uni i. of 
a host computer or an image pTOCCSSing device ; 

Fig, 9 is a flowchart illustrating one example of 
a second image data processing procedure; 

Fig. 10 is a flowchart illustrating one example 
10 of a third image data processing procedure; 

Fig. 11 is a flowchart illustrating one example of 
a fourth image data pi^ocessing procedure; 

Fig. 12 is a flowchart illustrating image data 
processing at a printer controller according to a fifth 
15 embodiment; 

Figs. 13A and 13B respectively show examples of a 
password input screen and a password-mismatch warning 
screen which are displayed on the host computer ±t\ 
image data processing; 
20 Figs, 14A, 14B, 14C, 14D and 14E illustrate 

examples of a mark and a character string which 
indicate being product ion ; 

Fig. 15 shows an configuration of an image forming 
system according to a sixth embodiment; 

I^ic?- 16 is a flowchart illustrating imago data 
processing at a printer controller in the image forming 
system shown in Fig , 6 ; 



Fig.. 17 ±s a flowchart illustrating image data 

processing at the px-d ntGr controller in a seventh 

embodiments- 
Fig, 18 shows a warning fsoreen for confirming 
5 acceptance of accounting of production in the image 

data processing according to the seventh fernbodi men i.. of 

Fig, 7; 

^ Figs- 19A and 19B respectively^ screen for 

displaying production-use information for confirming 
10 accounting information of production in the image data 

processing according to the seventh embodiment of Fig. 
7; 

Fig, 20 shows a configuration of an eighth 

embodiment of the present invention; 
15 Fig. 21 is. a flowchart for the eighth embodiments- 

Fig. 22 shows a display example of the eighth 

embodiment ; and 

Fig- 23 is another display example of the eighth 

embodiment . 

20 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
First embodiment 

Fig. 1 shows outer appearances of a configuration 
of an image px-ooessing system according to one 
25 embodiment oF the present invention. 

In the figure, a reference numeral 101 indicates a 
host computer and a numeral 102 indicates a print 



controller (i,e*, conv.x^oller ) . A numeral 103 indicates 
an image forming device (i.e., printer), which color - 
copies a manuscripi. mounted on a manuscript station and 
also outputs images sent from a host computer 101 via 
5 the print controller. 

The host computer 101 converts imago da La into 
information coded in the page description langucigc 
(PDL) and then sends it via a connecting cable to the 
print controller 102, 

10 The print controller 102 then translates PDL data 

sent from the host computer 101 and executes raster 
image processing to convert the PDL data into raster 
image data, which is subsequently sent via the 
connecting cable to an image forming device 103 to 

15 provide the corresponding images. 

Fig- 2 is a cross-sectional view of a 
configuration of the image processing device 103 showi-i 
in Fig. 1, which comprises: a digital-color image 
reader unit (hereafter called reader unit) 201 at its 

20 - top; a printer engine unit ( hereii^after called engine 

unit) 202; and an image processing unit 203 set between 
the reader unit 201 and the engine unit 202. 

The following will describe the configuration of 
the image forming device 103 and the operations of 

25 copying manuscript imcage^? as a copying machine . 

In the figure, when a manuscript is mounted on y 
manuscript sLaLion glass surface 31 and a copy start is 



execu-ted, illuminat;ion is reciprocated in a 
pi^ede-termined direction to collect; a light r-cif looted on 
the manuscript at a full-color sensoT^ formed 
integrally with an RGB thx^ee-color resolving filter 
5 through a lens 33 via rnirror^s 32a, 32b, and 32c, to 
obtain a color-resolving image analog signal, The 
color-resolving image analog signal is digitized at an 
amplifier circuit (not shown) and processed at an image 
proc<^ssing unit and then sent to the engine unit 202, 

10 A numeral 205 indicates an operating unit, whic;h is 

provided with a display unit and various keys (neither 
of which is shown), to give various settings and 
instructions to the image forming device 103, 

Ab the engine unit 202, an image- carrying 

15 photosensitive drum 1 is carried rotational] y in en 

arrow direction, around which are arranged a pre- 
exposure lamp 11, a corona charger 2, a laser-exposure 
optical system 3, s potential sensor 12, four 
developers (yellow developer 4Y, cyan developer- 4C, 

20 magenta developer 4M, black developer 4K), a drum- 

mounted light-quantity detecting sensor 13, a transfer 
device 5 , and a cleaner 6 . 

In the laser-exposure optical system, an image 
signal from the reader unit 201 is converted at a 

25 laser-output unit (not sltown ) into a 1 ighr • si gna ± , r^o 

that thus converted laser light is reflected on the 
polygonal mirror 3a and passes through the lens 3b and 
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•the mxirror 3c to be pT/ojected onto the surface of the 
photosensitive drum 1. 

When an image is formed by the engine unit 202, 
this photosensitive drum is rotated in the; ax^row 
direction to discharge l.:he. drum surface with the pre- 
exposure lamp 11 and then charge it uniformly w.lth t>ie 
corona charger 2, in order to subsequently illumi nati tkj 
a light image E for each resolving color so as to foxni 
a latent image on the photosensitive drum 1 f 

Next, the .predeterininGd developers ( 4Y, 4M, 4C, 
and 4K) are operated to develop the latent image on Lho 
photosensitive drum 1^ thus forming a toner image 
having resin as its base, on the photosensitive dr-uni 1. 
These developers (4Y, 4M, 4C, and 4K ) are each caused 
by eccentric cams 24Y, 24C, 24M, and 24K respectively 
to approach the photosensitive drum 1 for each 
resolving color. 

Next, the toner image developed on the 
photosensitive drum 1 passes through a recording- 
material cassette 7a and an intermediate tray 22 or 
recording-material ti^ays 7b and 7c axid then 
detection/conveying sys liems 50-52 and a transfer device 
5 and then is transferred onto a recording material 7 
(7a, 7b^ and 7c) supplied at a position opposing Uhe 
photosensitive dx-um 1 . 

In this embodiment also, th<^ transfer device 5 
comprises a trani^fcx^ dium 5a given a 
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recording-ma-terial holding means, a tiransfei: charger- 
SlD^ a sucking roller 5g opposing an absorbing chcvrger- 
5c for elec-tro-s-tatistically sucking the recording 
mairerial 7, an internal charger- 5d, an outside charger 
5 5e, and a cam-follower 5i, in such a conf igur a i.ion thriit. 

a recording-material carrying sheet: 5f made of a 
dielectric is extended and integrally formed in a 
peripheral opening region of the transfer drum 5a 
axially supported so as to be driven rotational ly, 'I'hfi 

10 recording-mater/ial carrying sheet Sf comes in a 

dielectric sheet (hereinafter called transfer sheet) 
made of a polycarbonate film etc. 

As the transfer drum 5a is rotated, the toner 
image on the photosensitive drum 1 is transferred onto 

IS the rec ordi^ ig materi al 7 carried on the xecording- 

material carrying sheet 5f, 

Thus, on the recording material 7 which is sucked 
and conveyed by the recording-material carrying sheet 
5f, a desired color image is transferred to form a 

20 full -color image , 

In the case of forming a full -color image, the 
recording material 7 on which a four-color toner image 
has transferred is separated from the transfer drum 5a 
by a separation claw 8a and then from the transfer 

25 sheet 5f by as separaring-and- I.i rting roller ab and a 

separat.ing charger 5h and then ejected from a trr^y lo 
via a thermal roller fixing devicc-i ( hei^<?iiiirif ter callcul 
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fixing device). 

Also, "the photosensit:ive. drum 1 aftei- completion 
of transfer is cleaned of residual surface toner with -r 
the cleaner 6 and then f^ent La Lhe image foT-inincj <;-i-.ep 
5 again. 

At the fixing device 9, a reference numexal 9g 
indicates a conveyor belt, which conveys to the fixing 
device 9 the recording material 7 separated from the 
transfer device 5- Nunnerals 9e and 9f indicate 
10 heaters, which heat an upper roller- 9a and an lower 
roller 9b . 

When an image is foirmed on the surface of a 
recording material 7, on the other hand, the recording 
material 7 is provided with an image formed on its ono 

15 surface is ejected from the fixing device Ns^and , 

immediately after that, a conveying-path switching 
guide 29s^s driven to cause the recording material 7 to 
pass through a conveying path and be introduced once 

onto a reversing path and when a reversing rol ler 

20 21b^otates in a reverse, direction, the recording 

material 7 is taken out starting from its rear end Lhu^; 
taken in last, in a direotion opposite to that It has 
been taken in. Then, t.he above-mentioned image foTiiiTru.j 
step is executed again, to form an image on the othax-^ 

25 surface. 

Also, to prevent the scattering and sticking of a 
fine particle on t.he recording-material carrying sheet 
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5£ of the transfer drum b ai:xd the sticking of oil or^ 
the recording material 7, they are cleaned by using a 
fur brush 14 and a backup fur brusli opposing e;ach other 
via the recording-material carrying sheet 5f, an oil- 
5 cleaning roller ^^l^gr^'and an oil -cleaning backup bru-yh 

opposing each other via the r-ccording-material carryincf 
stieet or a polishing roller l^'and a polishing 

roller backup brush 1 9 opposing each other via the 
recording-material carrying sheet ^^f^. Such cleaning ±^5 

10 carried out before or after image formation and every 

time when jamming (of paper) occurred. Also, in the 
configuration of this embodiment, Uhe eccentric cam 
is operated at desired timing to wox^k the cam follower 
^^^^formed integrally v/ith the transfer drum ^S^.<^thus 

15 making it possible to arbitrarily set a gap between the 
recording-material carrying sheet 5^ and the. 
photosensitive drum^^.3<" For example, at the standby or 
power-off, the gap is enlarged between the transfer 
drum SaXand the photosensitive drum 1. 

20 Fig- 3 . is a block diagram cSf'^a'configuration of 

the image processing unit shown in Fig. 2. 

In "l:he figure, a reference numeral 301 indicates a 
CCD reading unit, which comprises an amplifier for 
amplifying each of analog RGB signals i.npuL from the 

2 b CCD34 shown in Pig. 2, an A/D convortcr for conver I.Lt^c:] 

the analog RGB signals into for example S-bit digital 
signals, and a shading corrCiCting circuit fox- 




correcting known shading, etc., thus outputting digital 
RGB signals at 8 manuscript image. ^ 

A numeral 302 indicates a shift memory, which 
corrects a shxfU tor example between colors and pict\.irc 
5 elements of an RGH image signal input from the CCD 

reading unit in response, to a shift-quantity control 
signal sent from the reader controller 120. A numer-cil 
303 indicates a complementary-color converting circuir. , 
which converts an RGB image signal input from tiie shift 

10 memory 302 into an MCY. image signal. A numeral 304 

indicates a black-extracting circuit, which responds to 
a black-extracting signal input from the ireader 
controller 120, to extract a black x^egion of an image 
from MCY (magenta, cyan, and yellow) image signals 

15 input £3rom the complemen-tai^y-color converting circuit 

303 and then output a K (black) image signal for thus 
extracted black region. 

A numeral 305 ii^dicates a UCR circuit:, which 
responds to the K image signal input fi^om the black- 

20 extracting circuit 304 and the UCR-quantity cont.rol 

signal inpi.it from the reader contTOller 120, to executfit 
under-color removing (UCR) processing on the MCY image 
signal input from the complementary-color converting 
circuit 303, That is, i.he black-extracting circuit 304 

25 and t:he UCR circuit: 30 5 do not superpose. thuf=; cxtracLed 

black region onto 3-color (M, C, and Y) tonex' but. 
replace it with K toner, thus improving the color/ 



reproduct-ion performance. 

The K image signal output from the black - 
extracting circuit 304 is given as: K = A x min(C2, Y2, 
M2 ) . 

5 Where^ A indicates a black-extracting coefficient 

and C2, Y2 , and M2 respectively indicate M, C, and Y 
image signals output from the complementary-color 
converting circuit 303. The black-extracting 
coefficient A is determined by the black-extracting 

10 quantity control signal specified by the reader 

controller 120, 

MCY image signals ( Kl , CI, Yl ) output fx-om the UCR 
circuit 305 arc determined as: Ml = Bl x (m2 - d1 x k), 
Cl = B2 X (C2 - D2 X K) , and Yl = B2 x ( Y2 - D3 x K ) . 

1^ Note here that M2, C2. and Y2 represent MCY 

signals output from the complementary-color convert i ncj 
circuit 303, and coefficients Bl, B2, D3 , Dl, ID2, and 
D3 are determined by the UCR-Quantity control signal 
from the reader controller 120. 

20 Next, a numeral 306 indicates a masking circuit, 

which 'executes masking processing on MCY image signals 
input from the UCR circuit 30h in response to a 
masking-coef f icient control signal input from the 
reader controller 120, to remove liurbidity of the toner 

2b used and correct the RGB filtor propartios^ of the CCO . 

The MCV image signals (MO, CO, YO ) output from the 
masking circuit 306 arc expressed as follows: 
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(Matrix 1) 



^all ai2. ai:A (mi^ 
a21 a22 a23 ci 
ya31 a32 a33 



MO 
CO 

yo 



where all ttirough a33 indica-te masking coef f icien-ts , 
which are <3Gt:Grmineci by t:he masking-coef f icient: control 
5 signal specified by the reader controller 120; and Ml, 

CI, and Yl indicate MCY image signals output f^rom the 
UCR circuit 305. 

A numeral 307 indicates a selector, which selects 
a one-color image signal, and outputs an image signal 

10 VI, of the M, C, Y, and K image signals input from the 

masking circuit 306 and the black-extracting circuit 
304 in response to the color- selecting signal input 
from the reader controller to a selecting termTnal. S 
and the M, C, Y, and K image signals input from the 

15 print controller 102 via an external interface (1/F) 

^ circuit 308. 

A numeral 309 indicates a reader-gradation 
correcting circud t, which executes such gradation 
correction as shown in Fig. 4 on an image signal VI 

20 input from the selector 307 and then outpul.s an ima<.ja 

signal V2 . For ejKample, the roadcr-gradat i on 
correcting circuit 309 e^cecutes color-densi i-.y 
corireotion usiiig either oi^e of the conversion 
properties a through e (described later wil.h rcfe-Tence 

25 to Fig, 4) which are selected based on a 




giradation-correcti on selecting f^ignai specified by the 
reader controller 120, The setting by t:hifj reade-.r- 
gradation correcting circuit 309 is determined by the 
setting of image color-density by the copying-machine 
5 operating unit - 

A numeral 310 indicates a gradation correcting ' 
circuit, which corrects an image signal by selecting 
either one of the gamma -conversion properties C, 
and K (described later with reference to Fig. 5) 

10 according to an engine-color selecting signal input 

from an engine controller 110, to linearize the output 
property of an engine unit 202 for each color-. 

A numeral 311 indicates a laser driver, which is 
included in the laser-exposure optical system 3, The 

15 laser driver 311 modulation-drives a semiconductor 

laser based on an image signal V3 input from the 
engine-gradation correcting circuit 310, to form a 
latent image on the photosensitive drum 1 , 

Also, the image processing unit 203 comprises a 

20 CPU, ROMs, and RAMs (none of which is shown), to cause 

the CPU to govern the entire image processing unit.. 203 
based on a program stored in the ROMs* The kams l-it-T-e 
are used as a work region for the CPU, 

In the print controller 102, a CPU indicated by a 

25 numciral 104 governs the entire print controller 102 

based on a program stored in a memory 106 or a storage 
medium (not shown). A numeral 105 indicates a 



\5 




de-tecting circuit:, which executes copyright-information 
detecting processing describe later and outputs an 
image-output prohibition signal- Alfjo, the memory 106 
is used as a work region for the CPU 104 and as a 
5 storage region for image data transferred by the ho^t 

computer lOl and the image-output prohibition signal 
output from the detecting circuit 105, 

The following will describe the operations of the 
system including the print controller 102, 

10 Expansion of POL data refers to an operation of 

expanding PDL data to a full-color image by use of the 
host computei' 101 and then wrntirig it into the memory 
106 of the print controller 102, This full-color image- 
is stored, in agreement with the image forming device 

15 103, into the memory 106 as image data which is colox"- 

resolved into foui' colors of M, C, Y, and K. Note hex:c 
that this memox^y 105 stores also the image-output 
prohibition signal detected at the detecting circuit 
105 which executes copyright-information detecting 

20 processing which is described later. The image-output 

prohibition signal is i-cad out together with image data 
resolved into four colors from the memory 106 and .sent 
to the image forming device 103, 

If, in this case, the image-output prohibition 

25 signal i.c: not generated, image data sent: no Lhe image 

forming device is printed out, during which a full- 
color image stored in the memory lOft ±s re.ad out in 
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synchronization with the rotation of the photosensit ive 
dirum 1 and tlien sent to the laser driver 311. These 
operations are controlled by the CPU 104 of i.he prim, 
controller 102. 

Fig, 4 shows one example of the gradation- 
correction property of an i nijut/ou l:put signal at the 
reader-gradation correcting circuil. 309, in which the 
horizontal axis corresponds to the input signal ( input 
data) and the vertical axis, to the output signal 
( output data ) . 

Fig. 5 shows one example of the gradai.ion- 
correcting property of an input /output signal at the. 
engine-gradation correcting circuit 310, in which t>ie 
horizontal axis 00 i^x-C:js ponds? to titie input signal (input 
data) and the vertical axis, to the output signal 
( output data ) , 

The following will describe the operation of 
processing PDL data at the print controller 102, 

FigV 6 is a flowchart illustrating one exampl^sNof 



the first o^mage-data processing procedure i n an image 
processing sy^em according to this embod i merit; , which 
corresponds to "CT^ PDL data processing at t^'^e print, 
controller 102. NUS^rals 1 to 9 indicate the step 
numbers . \. 

First, the system receives one unit of PDT. data 
from the host computer 101 (step 1), This one unit may 
be a few byte, one page, or' one line as far as it fits 
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to the processing. Then, the system executes tcistex 
image processing (expansion) on thus rcoeiveci PDL data 
and then writes it :into the memory 106 (step 2). Ne^tL, 
the system checks whethex* daua processing (reception 
5 and expansion) of one page of the PDL data has been 
completed (step 3) and, if it decides i u is not 
completed yet, returns to step 1. 

If^ on the other hand, it decides it is completed, 
the system detects piroduction information, i.e. del.ecLs 
10 whether the production information is contained in i..he 
image data which has undergone raster image processing 
( 55tep 4 ) . 

This detection processing for production 
information, as described later, recognizes the 

15 production information by detecting the data of a mark, 
if any, attached to the image of the production which 
indicates: its copyright. 

Next, the system checks the results of detecting 
the production information given at step (4) (step 5) 

20 and, if it decides that the production information ha^:^ 
been detected, it does noL send the image data to the 
image forming device 103 bul; warns by display to the 
host computer 101 or the operating vinit: 250 Lo the 
effect that it cannot: output. l:he image data specified 

25 for printout because the it is production (see later- 

described Fig. 8A) and stops image output (step 9) l.o 
finish the prccessslng. in tthis case, Lhe image data is 



not: sent Uo t:he image fox^ming device 103 but the 
processing is all finished in the t^i-.i nt controller 102, 

At step 5, on the other hand, if it is decided 
that at step 4 no production i nf ormation has been 
detected in the image data at the time of production- 
information detection processing, the system, along an 
ordinary flow of image processing, reads out the RGB 
raster image data stored in the memory 106 and executes 
3.ogarithmic conversion to convert the RGB image data 
into MCYK image data (step 6), 

Next, the system sends thus converted MCYK image 
data to the image forming device 103 (step 7), to 
finish image processing of one page of data for the 
print controller 102, 

Next, the system, according to the above-mentioned 
image forming procedux^e, forms an image on a recording 
medium based on the image data sent from the print 
controller 102 and outputs thus formed image ( stfi^ip B), 
to finish a series of image forming processes - 

The above processing prevents digital - information 
version of production fir^m being copied illegally. 

The following will describe detection processing 
for production information. 

Figs. 7A to 7E show one example of a mark and a 
character string which indicate that the image data iy 
production. 

Figs. 7 A to 7C show one example of a mark which 
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indicates -that the imayc data is production; Fig, 7D 
shows oiie ex-ampie of a bar* code which indicates that it 
is production; and Fig. 7E shows one exampie o±" a 
character string which indicai:es that it is production, 
5 so that an image having any one of these shown by Figs . 

7A to 7e ±s accepted as production. 

[Detection processing for production information] 

In it premised here that an image with copyright 
has any certifying means indicative of production so 

10 that image data with copyright which has undergone 

raster image processing may be detected. 

For example, as shown in Figs. 7 A to 7D, a mark or- 
bar code indicative of production is determined and 
registex'ed beforehand. 

15 In this case, image data such as these production 

mark or bar code may be stored befox^ehand in 'the memory 
106 of the print controller 102, so that the detecting 
circuit 105 would execute pattern matching between this 
data and the above-mentioned raster-information 

20 processed data, thus detecting the concerned mark. 

Alternatively, in place of using such a symbol a^.- 
a mark or bar code, as shown in Fig. 7E, by providing 
production with a character string wh.i ch indicate^^ 
"production copy unauthorized" for example "This i inagc 

25 is production so cannot be; copied*' beforehand, the 

detecting circuit 105 may ciixecute block selection on 
one page o£ the above-mentioned raster-image processed 




image data, -to subsequenr.ly extract the cha.racter 
string data and recognize the concerned character 
string using a charactcr^ recognizinrj means, thus 
detecting that the image data is production to dctoct. 
5 the concerned character string, in this case alsc, a 
sample of a characLer string to be detected is stOT-c.^d 
beforehand in the memory 106 in the print controller* 
102. 

Further alternatively, in place of such character 
10 string as shown in Fig. 7E, an ID number indicative o£ 

an image with copyright is predetermined so that the 
detecting circuit 105 may extractfs character string 
data with that ID number to recognise the concen^ed 
character string using a character recognizing means, 
15 thus detecting that the image is pr/oduction* In this 

case also, the ID number uo be detected is stored 
beforehand in the memory 106 in the print controller 
102. 

Also, there are some cases where, as mentioned 
20 above, it is desired to avoid adding an extra visible 

image such as a mark or oharacLer Lo an image with 
copyright. In s\ich a case, such a technique may he 
considex^ed that pr-oduction information may be masked by 
embedding some add-on i nf o-rmat i on of a certain 
25 predetermined pattern of a few do lis express Kcid for 

example in a yellow color almost invisible to thcf. human 
eyes into an image with copyright. In this case also. 




such a me'thod may be^ considered that: this add-on 
information is stored beforehand in the meaur^iry 106 so 
that the concerned image is detected to be production 
by detecting the color and l:he add-on patl.en^. 

Still further alternatively, to mask produotion 
information, for image data of each picture element, 
few high-order bits starting from the LSB ( 3 eas L 
significant bit) may be used as a recognizing meaiis . 
In this case, the production information can be 
subdivided for each picture element, thus making it 
possible to recognise image data of Interest in such a 
way that its only one portion is an image with 
copyright and the remaining does not have copyright. 
Therefore, as mentioned above, only the portion of 
image without copyright of one page of image data can 
be output^ thus preventing such portions as decided tc 
have copyright from being output* 

Also, by forming a pattern by using thns few hit 
data for each picture element as a total one page to 
recognize image with copyright, a production-copy- 
prohibiting mark etc. can be masked as something like 
watermark into each one page of image data. In this 
case, such a method may be considered that product ion- 
recogni2:ing bits for each picture element rnay be 
e.xtiTf^oteid to r:nn?;titutci one page o£ image data and tht 
execute pattern matching on such production marks as 
shown in fig. 7A to 7D, thus detecting that the data 
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production. 

\^ Nor^e^^her-e tViat: t.he metzhod for de-teot incj mage ciata 

product'.ioi'iir&.^o't limif.ed uo the above - men tr. i oncc3 
example but: may be an5?^s^ far as il. scan detect tbat; 
5 the data of interest is prod&tsctior^ - 

Figs. 8A and 8B show one example of B warning 
screen displayed on the display unit of the host 
computer 101 or the display unit of the opcratix^g unit 
250 of the image processing device 103 . 
10 In Fig SA corresponds to warning display to -the 

effect that image data specified to be printed out 
cannot be output (i.e., printed out) because i I. i55 
production^ while Fig. SB corresponds to warning 
display that image data specified to be printed out 
15 could not be output (i.e., printed out) because it is 
production, 
[Second embodiment] 

Although the above first embodiment has been 
described in such a case of pex^forming prohibition and 
20 suspension of image output all at the print contx-ol 1 t-iT- 

102, such a configuration may be given that the print 
controller 102 itself may decide whether image data 
should be prohibited from being output, and send the 
information to the imago forming device 103, thus 
25 causing it to stop image output- The following will 

describe this embodiment. 

Processing of PDL. data at the. px int control Iot- 102 
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and the image forming device 103 is descrilr^ed with 
reference to a flowchart shown in Fig. 9- 

Fig . 9 shows one exainx:)lc of a second image-data 
pi'OCGSSing procedure, corresponding to the PDL data 
5 processing executed at the print contr-oller 102 and the 

image forming device 103. NoLe here that numerals 1 i.o 
12 indicate relevant step numbeTS* 

Description of steps 1 to 5 for receiving PDL data 
from the host computer 101 and detecting production 

10 information in image data which has undergone raster 

image processing is omitted here because they are I. he 
same as those of a procedure indicated by steps 1 to 5 
of the above-mentioned flowchart shown in Fig. 6. 
At step 5, the system checks the results of 

15 detecting the production information given at step (4) 
and, if it has decided that it has detected production 
information, it reads out RGB raster image data stored 
in the memory 106 and then performs logarithmic 
conversion to convert it into mCyk iniage data ( s Lep 7), 

20 in order to create an image-output prohibition signal 

and add it to the above-mentioned MCYK image data, 
causing control to go to step 9 . 

If, on the other hand, it decides that no 
production information has been detected in image dat.-;^ 

25 by the detection processing of the production 

information given at s l.ep 4, the fsystem similai-ly raad^ 
out RGB raster data stored in l:he memory 106 and l:hen 
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performs logarithmic conversion to convert the RGB 
image data into MCYK image dwta (step 6), causing 
control to go to step ( 9 ) , 

Next^ at step (9), l:he system sends the. MCYK image 
5 data to the image forming device 103. 

Next, the image forming device 103 chocks whether 
the image data sent from the printer control ler LC)2 is 
provided with the image-output prohibition signal (step 
10) and, if it decides that the image-output 
10 prohibition signal has been added, it fox^ms an image on 

a recording medium and outputs it (step 11), thus 
finishing a series of image forming px'ocessos * 

l\ i.'t decides that the image-output px-ohihi i.ion 
signal ha^ been added to the image data sent from the 
15 printer com.roller 102, l:he system gives the host 

computer lOlNox^ the operating unit 250 warning display 
to the effect tiaat mage data specified to be printed 
out cannot be ourteut because it is production (see 
later-described Fig\ 8A ) and also, to prohibit the 
20 image data being output, converts the image data all 

into a blank image and C)\tputs i i: ( s i:e.p 12), thus 
finishing i Ls processing. 

The above processing is abJe to prohibit di gi ti:*ic=id 
production from being copied illegally, 
7-5 [Third embodiment! 

This embodiment is described in a case of one 
example of data processing lor embedding production 
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information into image data i.o mask: it, particularly in 
a case of detecting an inconspicuous or invisible 
digital watermark indicative of production in order to 
detect production in-Forma t-ion . This embodiment is 
5 specifically described in such a case that a digital 
watermark indicative of production constitutes a 
production mark as image data for the entire one page. 

The following will describe operations, with 
reference to a flowchart shown in Fig* 10, of 

10 processing PDL data at- the print controller 102 cind tho 

image forming device 103- 

Fig. 10 is a flowchart illustrating one example oi 
a third image-data processing procedure, corresponding 
to the PDL data processing at the print controller 102 

15 and the image forming device 103. Note here that 

numerals 1 to 12 indicate the step numbers. 

Description of steps 1 to 3 for receiving PDL data 
from the host computer 101 for raster image expansion 
±s omitted here because they are the same as l.he above- 

20 mentioned processing procedure of steps 1 to 3 of th%- 
flowchart shown in Fig. 6. 

At step 4, the system checks, as follows, imacjt"i 
data which has been raster image processing to detect 
production information r.herein. First, the system 

25 extracts the low-order three bits starting from the LSB 
for each picture element. Lo create a digital -v^a termark 
signal which is a property signal. The system uses 
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this digit:al-wat.erinark signal as one page of detc^ "to 
create digit:al-wa1:ermark ini'ormatrion and image data, ;5o 
that it may perforin pattern matchincj to search this 
watermark information for a mark such as fOT- example 
those shown in Figs. 7A to 7C, thus detecting the 
production information . 

Next, the system checks i.he results of detecting 
the production information given at step 4 (step b) acJ, 
if it decides that the production information has been 
detected, i1: reads out RGB raster image data stored in 
the memory 106 and then performs logarithmic conver-yion 
to convert the RGB image data into MCYK image data and 
also coverts the image data, to prohibit its output, 
into a blank image (step 7) to create an i mage-ovi Lpu t 
prohibition signal and add it to the image data (step 
8), thus causing control to go to step 9. 

If, on the other hand, it decides that the 
production information has not been detected in the 
image data by the detecting processing for the 
production information at step 5, the system reads out 
RGB raster^ image data stored in the memory 106 and then 
performs logarithmic conversion to convert the hGh 
image data into MCYK image data (step 6), thus causing 
control to go to step 9 . 

At step 9, the system sends thus converted MCYK 
image data to the imago forming device 103, wh.ic>i then 
forms an image on a recording medium and outputs it 




( st:ep .10 ) , 

Next;, the image forming device 103 checks whoi.hc=^r 
t:he. image- output: prohibiti or> signal is added to the 
image data sent from the print cor^troller 102 (step 11) 
5 and, if it decides that the output prohibit Lon signaJ 

has not been added to the image data, it finishes a 
series of image forming processes - 

If, on the other hand, it decides that, the image- 
output prohibition signal has been added to the image 

10 data, it sends, to the host computer 101 or the 

operating unit 250, warning display (see Fig. 8B ) to 
the effect that the image data specified to be printed 
out cannot be output because it. is production, thus 
finishing a series of image formii-ig processes. 

15 Although the flowchart shown in Fig. 10 has been 

described in a case of converting image data into a 
blank image in the print controller 102, such a 
configuration may be employed that if the image-output 
prohibition signal is detected in the image processing 

20 device 103, the image data may be converted, in order 

not to be output, into a blank image and output as 
formed , 

The above processing makes it possible to use a 
production mark in which a digital watermark is 
25 constituted as imac^e data of the entire one page, to 

detect a production image whose production information 
is embedded into the image data to mask it so as to 




prohibit; the outputting of the one page of image data 
of the paroduction, thus preventing digitized pr oduc: l.ion 
images from being copied iiiegaily without adding an 
extra visible image suah ay a mark or character to the 
5 production image. 

[ Fourth embodiment ] 

Although the above third embodiment has been 
described in a case where a digital watermark 
indicative of production constitutes a production mark 
10 as an entire one page of image data, such a 

configuration may be employed that the digital 
watem^ark indicative of production corresponds to each 
picture element. The following will describe thift 
embodiment . 

15 The lollowing v/ill specifically describe 

operations of PDL data processing at the print 
controller 102 and Uhe image forming device 103 with 
reference to a flowchart shown in Fig. 11. 

Fig. 11 is a flowchart illustrating one example of 

20 a fourth image-data processing procedure, coxresponding 

to the PSL data processing at the print contTOl lc?.r 1()2 
and the image forming device 103. Note hc>i-e. that 
numerals 1 to 13 indicate the step numbers - 

Description of steps 1 to 3 for receiving PDL data 

25 from the host computer for rasLer image expansion is 

omitted here because they are the -^ame as i.he 
above-mentioned stops 1 to 3 for processing procedure 




of -the flowchart: shown in Fig. 6. 

At s-tep 4, -the sys1:em detieots checks, as follows, 
image datia which has undergone raster image proce?w^i ncj 
to detect production information therein. First, the" 
5 system extracts the low-order three bits starting from 
the LSB of each picture elanient to create a digital 
watermark signal, which is a property signal for each 
picture element, and image data. Using this digital 
watermark signal, the system performs pattern matching 

10 on predetermined production data, thus detecting 

production information about each picture element. 

Next, the system checks the results of detecting 
the production information given at step 4 ( step 5 ) 
and, if it decides that the production information has 

15 been detected for any pictux^e clement in the image 
data, it creates an image-output prohibition signal 
indicative of image-output-prohibited data (step 7) and 
reads out RGB raster image data stored in the memory 
105 and then performs logarithmic conversion to convert 

20 the RGB image data into MCYK image data (step 8) and 
then converts only such image data as detected to be 
production into a blank image to prohibit outputting of 
such portions of image data (picture elements) to be 
detected to be production (step 9), thus causing 

25 control to go to step 10. 

If, on the other hand, it decides at step 5 that 
the production infoi-mation has been detected in none ol 



■the pict:ui'e elements in the image data as a result of 
detecting the production inf ormatiox'i given at step 4, 
the system reads out RGB raster image data stored in 
the memory 106 and then pcrfoi'-mft logarithmic conversion 
5 to convert the RGB data into MCYK image data (step 6), 

thus causing control to go to step 10- 

At step 10, the system sends thus converted MCYK 
image data to the image forming device 103, which then 
foiTitis an image on a recording medium and outputs it 

10 (step 11), 

Next, the image forming device 103 checks whether 
the image-output pi^ohibi i.ion signal is added to the 
image data sent from the print controller 102 (step 12) 
and, if it decides that the image-output prohibition 

15 signal has not been added ^ it -Finishers a scries of 

image forming processes - 

If, on the other hand, it decides that the image- 
output prohibition signal has been added, the system 
sends warning display (see Fig. 8B) to the effect that 

20 the image data specified to be printed out cannot be 
output because it is production, , to the host computer 
101 or the operating unit 250 (step 1.3), thus finishing 
a series of image forming procossas- 

Although the flowchai-t shown in Fig, 11 has been 

25 described in a c^ase of converting image data into a 

blank image for each picture element in the print 
controller 102, such a configuration may be employed 

3' 




-that: if the image-output prohibition signal for each 
picture element is detected in the imacje prooessing 
device 10:-^, the concerned picture element would be 
converted, to prohibit the outputting of its 
5 corresponding image data, into a blenk image to form an 
image and output it. 

The above processing makes it possible to detect 
production information (digital watermark:) which is 
embedded corresponding to each picture element so as to 

10 pirohibit the outputting only of such image data of 

picture elements corresponding i:o the production image, 
thus outputting the information of portions other than 
the production image without adding an extra visible 
image svich as a mark or character to the production 

15 image, to prevent digitized production from being 

copied illegally. 

Although this embodiment has been described about 
a means of converting an output signal into a blank 
image as a means of prohibiting the outputting of an 

20 image^. such a configuration may be employed as using a 

method for scrambling for example any solid-black 
pattern iniage or data other than an original image or 
changing its magnification before oulipulting it or 
printing a message such as "production copy 

2 5 unauthox-ized" . 

[Fifth embodiment] 

Although the above-mentioned embodiments have 
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taken a measure t:o prevent e nox-nicil . pr i ntou I: when 
production information was detected, the -f ol 1 owin^ 
embodiment uses such a configuration that full -color 
data, production information (i.c-^ image-output 
5 prohibition signal), and a password (Which is detailed 

later) arc embedded into PDL da La received at the print 
controller 102 so Lhai. i.he image-output prohibition 
signal and the password may be written into the memory 
106 at the detecting circuit 105. 

10 Fig. 12 is a flowchart Illustrating the expansion 

processing of the PDL data by the print control.! ex 
shown in Fig. 1. 
Step S1201: 

The system receives PDL data in for each 

15 prescribed unit from the host computer lOl. The PDL 
data is received in one or multiple of such a unit as 
fitting to processing, e.g. units of a few bytes, one 
page, or one line. 
Step S1202: 

20 The system analyzes thus received PDL data and 

performs raster image processing to convert it into 
raster image data (i.e., RGD raster image data) and 
then writes it into the memory 106 - 
Step S1203: 

The system receives each page of the PDL data to 
decide whether it has undergone expansion processing - 
If, as the results of this decision, it is found 
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•that -the expansion prooessing has not: been compietod 
for t-hai: one page of "the POr, data, control returns to 
Step S1.201 to permits the system to repeat steps S1201 
to SI 203 again on the PDL dalia received in prescriboci. 
5 units- When that one page of the PDL data has 

completely been expanded, control goes to step S1204 . 
Step S1204: 

The system chec)^s the RGB raster image data 
(hereinafter called "image data" simply) obtained by 

10 the raster image processing executed at step 51202 to 

detect whether that data contains production 
information. This detection processing of product-ion 
information, which is derailed later, refers to such 
processing that detects a mark (i.e., production 

15 information) indicative of copyright from image dyta 

subject to processing. In this case, a password, which 
is embedded together v^ith the production information, 
of ~ the concerned image is also detected. 
Step S1205: 

20 Based on the results of the detection executed at 

step S1204, the system checks whether the production 
information has been detected from the mage data, that 
is, decides whether the production information has beeii 
added to the image data subject to processing to 

25 indicate that the concerned image data is producLion. 

If the results of this check indicate that the 
image data is production, control goes to the. 
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processing starting from step S1206 and, if not, goes 
to the processing starting from step SI 212* 
Step S1206: 

If the image data subject to processing is 
5 production, it is copy-pro l-ec Led to prohibit the 

outputting the image. 

Therefore, here first, to check a password g-iven 
to release the above-mentioned copy-protection, the 
password-check counter is returned to "O". 
10 Step S1207: 

I'he system causes the host computer 101 to display 
such a password-entry screen as shown in Fig. 13A, to 
ask the user to enter the password. 
Step 1208: 

15 The system compares the user's password entered on 

the password-entry screen displayed at step S1207 to a 
password detected by the detection processing executed 
at" step S1204, to decides these two passwox^ds agree 
with each other. 

20 If it is decided that they do not agree, contro.l 

goes to the processing starting from step Si 209 and, if 
they agree, control goes to the processing starting 
from step S412. 
Step S1209: ' 

2^ If the user's password did not agx-^oo vjith the 

image data's password, the system adds "i" to the 
password-check counter which has been cleared at step 
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S1206. 
Step S 17.10: 

The sys-tein (decides wheLlier, as a x-esult ol 
processing executed at step S.1209 , the pas sword -check' 
5 counter indicates a value of "2" or higher. This 

decision is made to permit the usc?.r to enter his 
password again if he has mistook in entry of the 
password. 

If it is decided that the counter val ue is less 

10 than "2", control returns to step S1207, to permit the 

user to enter his password age in . If, on Lhc o i;her 
hand, the value is "2" or higher, that is , if the user 
has mistook the entry of his password twice , control 
goes to suep Sl2ii. 

15 Step S121.1: 

If the user has mistook the entry of the passwor-d 
twice, the system does not . send image data subject to 
processing to the printer 103. With this, the 
concerned data is prevent from being output* Insi-.ead, 

20 the system causes the host computer IQl to display 

warning such as shown in Fig- 13B to the effect that 
specified image data cannot be output because 
disagreement between these two passwords. Then the 
system finishes the processing . 

25 Thus, in this case, the image data is noL fseni. Lo 

the printer 103 , to finish the processing all in i.hc 
print controller 102, 
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Step S1212: 

If the results ol decision at step S405 Lndicatei 
that the image data subject to proce.f^sing is not 
production or those at step S408 indicat.e that the 
password of the image data which is produo t-ioii has 
agreed with the user's password, the system, along an 
ordinary image processing flow, reads out image dai:a 
(i.e., RGB raster image data) stored in the memory 106 
and then performs logarithmic conversion to convert 
that data into MCYK image data. 
Step S1213: 

The system sends the MCYK image data obtained at 
step S1212 to the printer 103. With this, image 
processing of one page o£ image data is finished. 
Step S1214: 

Th^printer 103 forms an image based on the image 
data sent B^rom step S1213 on a recording medium 
according to ishe above-mentioned mage forming procedure 
and outputs it, \^ 

If there is provided a plurality of pages of image 
data, the system executes processing starting from step 
S1201 again. 

The above-mentioned detecting processing of 
production information ex;ecuted at step S1204 is 
specifically described as f ollov/s . 
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s premised here that the production image data 



has some certifying means (i.e., pi-od\ic:t ion 
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inf oirmation ) indicative of production so that it. can bo 
decided whether rastei- image processed image data is 
production image data (i.e., image data with 
copyright ) . 
5 (Certifying means .1) 

For example, as shown in Figs, 14A to a mark 

or a bar code indicative of production is determined 
and registered beforehand and the embedded into 
production image data, 

10 In this case, t:he above-mentioned mark or bar cudt- 

already registered is stored in the memory 106 in the 
print controllex^ 102 beforehand. With this, the system 
performs pattern matching between this stored data and 
the above-mentioned raster- image processed data to 

15 detect the concerned mark, thus deciding whether the 
image data sub.jcct to processing is production. 

As for a password for image data of production, on 
the other hand, in place of a mark and bar code, for 
example the above-mentioned ID number of the concerned 

20 image data (production image) determined beforehand 

such as shown in Fig. 14E is embedded. 

In this case, the system ex-tracts as chax'^actcr - 
, string data the ID niimbcr from image data subject, t.o 
processing in which uhat lo number is embedded, i.o 

2-5 recogni2:e the concex^ned chnractier string by u.siruj « 

characl:er-recogTii7.ing means, so as to confirm, a 
password cox^respbnd i.ng to that number (becaufse ttiis 
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password corresponding to the ID number is a i^ort of 
data piece encrypted by an cxypi-.o-analyzing circuit 
included ion r.he detecting ciTCuit 10b), thus 
recognizing the password. 
5 Note here that on3.y the password data may be used 

as bar-code data such as shown .in F±q. 14D. 
{Certifying means 2) 

If, as mentioned above, in oidcr to avoid adding 
an extra visible image such as a mark or character to 

10 production image data, the production information is 

masked by for example embedding beforehand a few dots 
of predetermined pattexn^ of add-on information 
(expressed in yellow hard to see with the >iuman eyes) 
into the concerned image data. 

i5 In this case also, the above-mentioned add-on 

information is stored in the memory .106 beforehand, t.o 
detect the color and r.he add-on pattern, thus detecting 
the production and its passwoxd . 
( Certifying means 3 ) 

20 A few high-order bits starting from the LSB of 

each picture element of image data axe used as a 
certifying means in order to mask the production 
inf orma-ttion (digital wa l.er^mark ) . 

In this case, since the production information cari 

25 be subdivided for each pictuiG;- olctiment, it is possible 
to recognize only a portion of certain image, data as a 
production image and the remaining as a non-production 




image- Therefore, as men-fcioned later, it is also 
possible tO' output only the portion of an non- 
production image of one page of image data and not l.o 
output those portions that have been decided to be 
production imago dai.a. 
(Certifying means 4) 

By forming a pattern using the above-mentioned few 
bits of data for each picture element as the entire one 
page for recognition of production images, a production 
prohibition mark etc- is embedded as a watermark ini.o 
one page of image data to mask each image data - 

In this case, the system extracts the production 
the recognizing bit data of each picture element to 
constitute one page of image data and then perform 
pattern matching between such a mark and a bar code as 
shown In Figs, 14A to 14D, thus detecting that it is 
production. 

Note here that the method foi^ detecting production 
information or a password from image data subject to 
processing is not limited to the above-mentioned 
methods described in Certifying means 1-4, 550 tJiat any 
method may be used as far as it can detect that 
concerned image data is production or it can deuect a 
password. 

( Sixth embodiment ) 

This embodiment is applied for example in an imaqe 
forming system 1500 such a?; shown in Fig. 15. 



This image foniKlrig system 500 has a conf iQura i.ion 
similar to that of the^ ahove-mei^ l.ioned image foarming 
system 100 shown i ^^'ig- 1, ext:ept that when an images 
is pi-ohibi ted fx-om being output bcaause its production 
5 information is detected, thi.s system 500 aooe^sses i.he 

author's side host computer 1502 connected to the. prim, 
controller 1503 over a network, to release that state 
of image-output prohibition. 

Detailed description of the above-mentioned image 

10 forming system 1500 shown in Fig. 15 is omitted here 

because its components operating in a manner similar to 
those of the above-mentioned image forming sy^st.em 5;hown 
in Fig, 1 are indicated by the same reference nunieT-alf^. 
In the image forming system 1500, the above - 

15 mentioned author ^s side host computer (hereinafter 

called ''first host computer") 1502 is connected to tho 
print controller 1503 over a network. 

The print controller 1503 transfers the 
information which identifies production's image data 

20 and its password with the first host computex" 150'^. and 

also transfers output permission for image data -to be 
output from rhe printer 103 or production's image data 
with a general user's host computer (hereinafter called 
"second host compuLer'* ) . 

25 The host computer 1502, like the above-mentioned 

host computer 103 shown in Fig. 1, converts image dat.a 
into information coded in a page description language 




( PDL here) and sends i I. l:o I. lie. print cont:roller .1503 
via a connec-ting cable. 

Therefore, the print controller 1503 analyses pdi- 
data sent from the second host computer and converts it 
5 into raster image data and then sends it to the printer 

103 via the connecting cable. During this procesfiinQ , 
if production informal.ion is detected from among tt^at 
raster image data by the detection processing, the 
system first obtains acceptance' for printout permission 
10 from the concerned author's side the first host 

computer over the network and then sends the image data 
to the printer 103, 

Fig, 16 is a flowchart illustx-ating the eKpan5;ion 
processing for PDL data executed at the print 
15 controller 1503. 

Detailed description of the above-mentioned 
flowchart shown in Fig. 16 is omitted here because its 
like steps are indicated by the same step numbers as 
those for the flowchart shown in Fig, 12. 
20 Steps S1201-1205: 

The'"system receives PDL data from the second host 
computer 1501 and then converts it into raster imac^o. 
data, to detect production information and the password 
based on that image data. 

^'^ the results of this detection processing 
indicate that the concerned image data is production, 
control goes to processing starting from step S.L601. 




This processing differs from that in the above- 
mentioned fifth embodiment - 
Step S1601: 

I£ the concerned image data is production, to 
5 check the password in order \:o release a copy- 
protection state, the system causes the second >iost 
computer 1501 to display a password-entx-y screen (see 
the above-mentioned Fig. 13A), to ask the user to enter 
the password . 
10 Step S1602: 

The system sends to the author's side first host 
computer over the network the user's password enter-ed 
on the password-entry soi-eon at step si 601 together 
with the ID number for identifying the corresponding 
15 mage data. 

Step S1503: 

Checking of the password for the ID number of uhc 
im^ge data sent at step S1602 is executed in the first 
host computer, 

20 Step S1604: 

If as a result of check executed at the first host 
computer 1502 at step S1603, the password cannot be 
identified^ to prohibit the outputting of uhe concer-ned 
image data, the system does not send that imcige datci to 

25 the printer 103 but does it causes the second host 

computer IbOl to display warning to the effect that the 
specified image data caianot be ovitput because of 




disagi^eeitiGnt; of the password ( fsee l:he abovo-inon-tione-d 
F±g- 13B). Then, this processing is finished. 
Step S1605: 

Tf, as a result of check cxticuted by the fir?ri. 
5 hos1: computer at; step 1603, the password is identified, 
the system issues output permission to the second host 
computer. 

Then, the above-mentioned steps S1212 to 31214 are 
executed, to output the concerned image data from the 

10 printer 103. 

( Seventh embodiment] 

The above-mentioned sixth embodiment employs such 
a configuration that to release an output-prohibi Led 
state for image data provided when production 

15 information was detected from among the image data, the 

system accesses t.he author side first host computer 
connected with the print controller 1503 over the 
ne'twork to release the image-output-prohibi Led sLal.e* 
In this seventh embodiment, however, instead of 

20 prohibiting the outputting of image data, the sysLom 

gives (the user of) the second host computer 1501 the 
warning to the effect that the concerned data is 
production and then prompts the author's side first 
host computer 1502 for accepting accounting and then 

25 posts the concerned output information to the> riuthor * 

Side first host computer 1502 according to the numher- 
of printout sheets given by the second host compul.er 
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150] (user) a the printer 103, for automatic 
accounting , 

For this purpose, expansion of PDL data executed 
at the print, controller lb03 comes in for example ^'^uch 
5 processing as shown in Fig. 17. 

Detailed description o± the riowchart shown in 
Fig, 17 is omitted here because its like steps are 
indicated by the same step numbers as those for the 
flowchart shown in Figs. 12 and 16. 
10 Steps S1201-S1205: 

The system receives pnc data from the second host 
computer and then converts it into raster image dat.a, 
to detect the production information and password f-roni 
among the image data . 
15 If the results of this detection processing 

indicate that the concerned image data is production, 
control goes to processing starting from step S.1.701- 
Th±s processing differs from that of the above- 
mentioned £ifth and sixth embodiments. 
20 Step S1701: 

If the concerned . image data is production, the 
system gives the second host computer IbOl the warning 
to the effect that accounting is imposed if for example 
such printout as shown in Fig. 18 is executed in order 
to notifies it of the specified mage data (image to be 
printed out) being production. 

This warning screen pxompt:s for the execution of 
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prin-tout; of the information (printout information) ol 
image data to be printed put and, at the same liime, for 
acceptance of its autoniatic pbs t;iag to the author's 
side. 
5 Step J 702: 

The system decides whethc.x" a user * s instruction 
given on the warning screen at step 1701 indicates 
acceptance of accounting and printout of the image 
data, 

iO l£ the results of this decision indicate user's 

acceptance for accounting, control goes to ttio abovc?.- 
mentioned processing starting from step Sllil2 and, 
otherwise, goes to step S1703 . 
Step S1703: 

15 If the user does no accept accounting, the syfsLem 

does not send the image data to the printer 103 but 
stops the outputti ng of the image data. Then, l.hl_^ 
prbc&SSing is finished. 
Steps S1212-S1214: 

^0 If/ on the other hand, the user' accepts 

accounting, the system, as mentioned above, sends the 
image data to the printer 103. With this, the printer 
103 prints out. l:he concerned image daLa (i.e. one £jacjo 
of printout). Then, control goes t.o step S17CD4. 

25 Step S1704: 

This step is executed even when the concerned image 
data is not producLion. Therefore, the system decides 



whe-their Image data printed out by t.l^e pjrinter 103 is 
production . 

Only if the results of Uhis decision indicate that the 
printed out image data is prodiicr.ion, control goes l.o 
b step S1705 and, otherwise, t>n^> px-occ^^sing Li^ finishefi. 

Step S1705: 

If the printed out image data is production, tluft 
system, for example^ causes th^ user side second hosi: 
computer 1501 to display output information of tl^c 

10 production including accounting information such as 

shown in Fig, 19B, 'r>ie sysfcom also causes the author's 
side first computer 1502 to display printout 
information o£ the production such as shown in the 
above-mentioned Fig, IQA. Then, this processing is 

15 finished, 

( Ej.ghth embodi ment ) 

The seventh embodiment has been described in such 
a case that the author's side host computer performs 
accounting, to permit production to be printed out, 

^-0 The eighth embodiment, on the other hand, 

particularizes, when image data is printed, an author's 
host computer based on copyright information contained 
in a form of a digital watermark in the image da La, 
thus making it possible to obtain an image dal.a lifti. 

25 relating to the image data Lo be printed, from this 

author's side host computer - 

Fig, 20 shows a configuration of tlie eighth 
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embodiment;. Fig. 21 shows a flowchart: of -the 
processing by the eighth cmbodimen 1: . 

When it: is instructed to print y desix^arl Imag^. 
data file (step S1201 ) , the user side host computer 
5 2004 activates its own software for detecting a diy.-i ta 1 
wateiTnark (which may be embedded into the above- 
mentioned three bits starting Irom the LSB or 
superimposed on a particular frequency in the image.) 
(step S2102), thus detecLing the digital watermark 
10 embedded in the instructed image data file (step 

S2103). 

Note here thai; if the digital-watermark: detectiiig 
software has been activated already, step S2i02 ccjn bo 
passed. 

15 Thus detected digital watermark contains 

information about the above-mentioned image data 
desired to be printed and also information of the 
author's side host computer . 

The^^<nf ormation abut this image data desired to be 
20 printed is ( 1 r"-*j,ddress information of the auLhor'?; s-ide 
host computer whichriv^nages the copyright of the other 
paintings if the above -mei^t^ned desired image da La if; 
one panting of his, and ( :x ) adb^ss information of a 
host, computer which manages the notbs of the other 
2b melodies of a compO£ic:;r if ,that d^f^sired rrRage data is 

the documeni. of one of his, and (3) address oTi^^tormation 
of the author's side host computer which managesXhe 



- 49 - 



o-theH. books if "that: desixed -imaqe data is one of hi^;, 
and ( 4 )^*^dT Gtss int'ormatiion of -the evi ulior ' s side >i05i;t. 
computer wni^ch manages the other photographs o± a 
photocjrapher ifvtihat desired image data is one of t.he 
5 photographs he toaif. 

Next, the digital-watermark detecting software, 
based on the information r/elating to the desired 
printout image data which is detected, gives the user 
side host computer 2004 on its display the inquiry ior 

10 whether it wants to obtain images relating to an image 

desired to be printed (step S2104)- 

If the user has replied YES to this inquiry, the 
user side host computer 2004 uses the addretss 
information obtained from the detected digital 

15 watermark, to access the home page of the author's side 

computer 2001 over the Internet (step S2105), thus 
obtaining an index (the above-mentioned image data 
list) of the charge of the image contents possessed by 
the author's computer 2001 as shown in Fig* 23- 

20 No*fe;e here that the image contents may not be 

introducedswith their- producer names (as shown in Fig, 
23) but be d^s^played as thumb-riail magef^ (down-sized 
images ) . 

The user of the user side host computer 2004 
2 5 sGalec2t£5 a dosired image frcjin among Lhe above-man tioned 

index and the thumb-nail images, to enter the cred.i t 
card number and enter a transmission instxiiotion , 




•thereby causing the aut:hor ' ft side host computer 2001 to 
send the selected image to the usscr- side host compuUer. 
Also, the charge for the selected image is ciccounf.ed to 
the. credit card at the aulihor's side host computer 
2001. 

Also, if NO is replied at step S2104 or ci 
suspension instruction is given at s l:ep S2107, the 
processing is finished. 

The image, when received, is printed by the 
printer 103 . 

Although the above-mentioned embodiment separately 
activates the digital-watermark detecting softwarcft, a 
print driver, when the user side host computer 200^ 
instructs printing, may be provided wi l:h functions of 
the digital -watermark detecting software and Internet- 
connecting software so as to execute processing of step 
2103 and the subsequent shown in Fig, 21 in response to 
a printing instruction. 

Also, although the above-mentioned embodiment, is 
limited to a case of still images as image contents 
received from the author's side computer because of its 
configuration of printing image data at the px inter 
103, the contents may be reproduced as movies or 
musical notes by using the image-reproducing decoding 
softwares or speech-reproducing decoding software of the- 
user side host computer, 

Tn th.is cascri, the f^yfttem instructs one frame of 
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image of a movie or an imaqe of the music Jacke-t, t;o 
deatect. a digital wa-termark for thi.y image, thus 
executing si.eps S2105-71(3fi. 

Also, although the above^-mentioned eniboriimeiit has 
S such a configuration so as to receive image contents 

only from the author's side host computer 2001, when 
the digital watermark .-i nf ox^mation contains afidresses of 
author's host computers at a plurality of areas 
(author's side host computers 1, 2^ and 3), an index oi 
10 the image contents and charge may be received from thffi 

author's side host computers of the plur-ality of areas 
and displayed sequentia!! ly at the user side host 
computer . 

Also, if the digital -watermark detecting sofi.ware 
15 takes for its processing execution so long a timo^i 

(e*g*, three seconds or longar) as to inflict some- 
stress on the operator, the system may execute step 
S2104 after step S2101 in order to execute steps S2102, 

S2103, S210S when YKS is replied. 

20 Also, although the flowchart shown in Fig. 21 is 

used in description, the mear^s for executing the 
processes shown in Fig, 2J. i of course provided to 
each component shown in Fig, 20, 

Also, the above-mentioned embodiment of course can 
25 be achieved also hy supplying a storage, medium which 

stores a program code for .sofLv/are which realizes the 
functions of t.he host computer and its terminals of 



each of the above-mentioned embodiments to the system 
or device so that a computer (or CPU or MPU ) of uhat 
system or device niay read out the program code storud 
in the storage medium and execute i I. - 
5 In this case, the px^ogram code itsi^lf read out 

from the storage medium rea.l iz.e.s the functions o£ each 
embodiment^ so that the storage medium which stores 
that program code constitutes the present invention. 

The storage medium for- sxipplying a program code 

10 may come in a ROM, floppy disk, hard disk, optical 

disk, magneto-optical disk/ CD-ROM, CD-R, magnetic 
tape, nonvolatile memox-y card, etc. 

Also, by executing a program code load out by the 
computer, the functions of each embodiment not only cc»r^ 

15 be realized but also the OS etc. operating at the. 
computer can execute part or all of the actual 
processes, of course thereby realiz^ing the functions of 
each embodiment* 

Also, after a program code read out from the 

20 storage medium is written into a memory pxovidecl to a 
function-expansion unit connected to an expansion- 
function board inserted into the computer or a 
function-expansion unit connected to the. computer, 
based on instructions of that program code, the CPU 

2Sd etc. of that function-expansion board or thot funotion- 

expansion unit may of course execute pari: of all of the 
actual processes, thereby x^ealizing the function;.:; cjf 



each embodimen-t . 

As described above, -the above-mentioned embodiment 
detects whether px-^cdetermined information (which Is^ 
indicative of produc i.ion ) in image data when tt^a u image 
b data is sent from the user side terminal and to be 
output from an output "device (i.e., image formincg 
device, printer^ etc.)- If the results of this 
detection indicate the px-esence o£ the production 
information, the system prohibits the outputtinQ oi 

10 that image data at the output device. In this ca-se, 

the system causes the user side terminal i:o for example 
display a screen which prompts it to enter a password 
issued from the author's side or confirm that the 
concerned image data is pxoducUion, thereby releasing 

15 an output-prohibited state of the above-mentioned image 

data based on infoi-mation (i.e., information of the 
entered password or accountirig acceptance) retux-ncd 
from the user side terminal. Alternatively, the system 
sends that information retux^ned from the user side to 

20 the author's side terminal, to release an output- 

prohibited state of the above-mentioned image data 
based on Lhat returned information (i.e., information 
of the results of checking the password etc ) - 

With this, when the user who asked for- the 

2b outputting of image data which is pr-oduction has 

permission from the aul.hor's side, an output-pxohii3i i.c^d 
state of that image daLa ift automatically re]eafi;c(3. 



•thus permitting an output device to output it. 

Specifically, a device or system wliich to p^rotect 
digitized production and prevent its illegal copying, 
detects production information (i.e., p.ro.determined 
5 information) embedded in that image?, data to proliibit 

its output can release a printout-proliibited .stai.e oi 
the production when it has obtained permission fiom Lhc; 
author's side, so that it can making sv/itch-ove^r 
between a copy-permitted state and a copy-prohibl Led 

10 state according to whether it is authorized to outpuL 
the production image. Also, it can automatically give 
accounting to an image which is output production and 
also causes the author's side and the user to cor\firm 
that accounting information locally. 

15 Therefore, it is possible to automatically make 

switch-over between a copy-permitted stalie and a copy- 
prohibited state according to the type of production 
while securely protecting uhe production. 



